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METHOD AND APPARATUS FOR PROVIDING VISUAL FEEDBACK DURING 
MANIPULATION OF TFXT ON A COMPt iTER SCRFFN 

FIELD OF THE INVFMTinN 

The present Invention pertains to a method and apparatus for providing 
user feedback in a computer system. More particularly, the present invention 
pertains to a method and apparatus for providing visual feedback to a computer 
user while manipulating text on a computer screen. 
BACKGROUND OF THF INVENTION 

Many computer systems include graphical user Interfaces. Graphical 
user Interfaces typically include a user interface window, more commonly 
referred to as a desktop window. While operating within the desktop window 
computer users are able to manipulate graphical objects, I.e. Icons, using a 
cursor control device such as a mouse or trackball. Icons can be moved simply 
by pointing, clicking and dragging. During these operations the computer user 
receives visual feedback that enhances the feeling of physical control over the 
desktop window and the Icons therein. For example, selected icons are 
highlighted and, while the mouse button Is held down, the selected icon moves 
with the cursor. 

Moving text within word processor files Is not as easy. Highlighted text 
cannot be dragged about a document as if It were an Icon. There is no way to 
"grab" the highlighted text. As a result, computer users do not have a feeling of 
physical control during cut. copy and paste operations. 
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SUMMARY OF THF rMVpNTP^I 

The present invention provides a method and apparatus providing visual 
feedback to a computer user while dragging selected text. As its first step, the 

u 

processing logic of the present invention creates a text object from the selected. 

highlighted text when the computer user initiates a drag. Simultaneously, the 
^ selected text is visually de-emphasized. Secondly, after the cursor begins to 

move, the processing logic snaps the text object to the cursor so that the text 
? object follows the cursor without obscuring the insertion point. The computer 

user is then free to move about text onscreen in search of an insertion point. 
''^Finally, when the computer user selects the insertion point, the selected text is 

visually zoomed from the source location to the insertion point. As a result, the 
'■L computer user has a feeling of physical control while moving selected text 

within a document. 

Other objects, features, and advantages of the present invention will be 

apparent from the accompanying drawings and the detailed description that 

follows. 
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BRIEF DF.q rRIPTION OF THE FIGlJRF.q 

The present Invention is illustrated by way of example and not limitation 
in the figures of the accompanying drawings in which references indicate 
similar elements and In which: 

Figure 1 Is an Illustration of a computer system. 

Figure 2 is a flow diagram of a method of providing visual feedbacl< while 
directly manipulating text. 

Figure 3 A Illustrates the selection of text. 

Figure 3B illustrates the change of cursor caused by a mouse down 

event. 

Figure 3C Illustrates the placement of the text object relative to the cursor 
during a drag. 

Figure 3D illustrates the tracking of the text object during a drag. 
Figure 3E illustrates the placement of the text object after a mouse up 

event. 

Figure 4A illustrates a bounding rectangle at a source location. 
Figure 48 illustrates a bounding rectangle at a destination location. 
Figure 4C illustrates a zoom from a bounding rectangle at a source 
location to a bounding rectangle at a destination location. 

Figure 5 Is a flow diagram of an Idle loop for changing the shape of the 

cursor. 
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DETAli FD npshniPjinf^ 

<^ Figure 1 illustrates a computer system 10 in which the present 
processing logic of the invention operates. Computer system 10 Is Illustrated as 
an Apple Macintosh™ computer system, however, those of ordinary skill in the 
art will understand that alternative computer systems may be used. Computer 

^ system 10 includes a monitor 12 for visually displaying information to a 

computer user, a central processing unit (CPU), and internal memory, enclosed 
P by housing 14. Keyboard 16 allows a computer user to provide input to the 
CPU. Computer system 10 also includes a cursor control device, such as 
mouse 1 8, or a trackball, joystick, or special keys capable of signaling 
movement In a particular direction. By moving mouse 1 8 the computer user is 
able to control the movement of the two or three dimensional movement of a 
visible symbol, such as cursor 20, on monitor 12. Computer system 10 also 
Includes a signal generation device for signaling active and inactive control 
states. The signal generation device may be realized using a switch or button 
19 on or near the cursor control device. The up position of button 19 signals the 
inactive control state while the down position of button 19 signals the active 

'Control state. 

Computer system 10 Includes an operating system capable of tracking 
the position of mouse 18 and cursor 20. The operating system also detects the 
state of the signal generation device and reports the position of cursor 20 in 
each state of the signal generation device. These features of an operating 
system are well known In the art. Therefore, they will not be described in detail 
here. 

The processing logic of the present Invention is stored within the Internal 
memory of computer system 10, or on other machine readable media, and 
executed by the CPU. The processing logic can be separately compiled or 
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loaded entity or incorporated as part of a larger word processing system. In 
either case, the processing logic of the present invention may be activated 
using techniques well known to those of ordinary skill in the art. 

Briefly described, the processing logic of the present invention provides 
visual feedback to users of computer system 10 during direct manipulation of 

^ text within a word processing application. That visual feedback includes de- 
emphasizing selected text at a source location, creating a text object resembling 

^ the selected text and "snapping" the text object to the pointer such that the text 
object travels with the pointer. Once a destination location is chosen, the 
selected text Is visually "zoomed" from the source location to the destination 
location. 

Figure 2 illustrates In flow diagram form the operation of the processing 
logic of the present Invention. Rgure 3 Illustrates the effect of the processing 
logic upon selected text 30 in relation to displayed text 32. 

Referring now to Figure 2. the processing logic performs two major tasks: 
determining whether visual feedback Is required and providing that visual 
feedback. In steps 50-58 the processing logic determines whether visual 
feedback Is required. The computer user indicates the desire for visual 
feedback by pressing mouse button 19 down while cursor 20 is over selected 
text 30, continuing to hold down mouse button 19 and moving cursor 20 from its 
position at the time of the mouse down event. The processing logic generates 
visual feedback during the manipulation of selected text 30 In steps 60-90. The 
processing logic generates visual feedback for the computer user until after 
mouse button 19 Is released; I.e., returns to the up position and the Inactive 
state. Visual feedback while mouse button 19 Is down Includes generation of a 
text object, snapping the text object to the cursor, flashing the insertion caret at 
location under cursor and moving the text object with the cursor. Once the 
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computer user releases mouse button 19 it returns to Its up position, selected 
text 30 is visually zoomed from the source location to the destination location. 

The processing logic is not activated until after text has been selected 
from the text displayed on monitor 12. In Figure 3A, selected text 30, "Once 
upon a time." Is Indicated by reverse video, which distinguishes it from text 32 
displayed on monitor 1 2. 

After text 30 has been selected, the processing logic waits In step 50 for a 
mouse down event. When the mouse down event occurs, the processing logic 
is also informed of the cursor position at the time of the mouse down event. Let 
us refer to this cursor position as the "mouse down position." Afterward, the 
processing logic advances to step 52. 

In step 52 the processing logic determines whether the computer user 
may require visual feedback to accompany the manipulation of selected text 30. 
This determination is made by comparing the mouse down position to the 
coordinates of selected text 30. The user does not require visual feedback for 
text manipulation if the computer user pressed mouse button 1 9 down while 
cursor 20 was not over selected text 30. in that case, the processing logic 
branches to step 54 to handle the mouse down event in a conventional and 
appropriate manner. On the other hand, visual feedback may be required if the 
mouse down position was over selected text 30. The processing logic 
advances to step 56 to determine if so. 

In step 56 the processing logic waits to see if the computer user requires 
visual feedback to accompany manipulation of selected text. The computer 
user does not require visual feedback if a mouse up event occurs before cursor 
20 is moved from the mouse down position. Accordingly, the processing logic 
branches to step 54 to handle the mouse up as if a mouse down event occurred 
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at the original mouse down location. However, in the absence of a mouse up 
event, the processing logic branches to step 58. 

In step 58 the processing logic determines the current position of cursor 
20. Let us refer to this position as the "current cursor position." If the current 
cursor position is some arbitrary distance away from the mouse down position 
the computer user has indicated a desire to move, or pick-up, selected text 30. 
In one embodiment, the current cursor position is chosen to be three pixels 
away from the mouse down position to indicate a deslre to manipulate selected 
text 30. The distance chosen may vary according to needs of the computer 
user. The processing logic responds to movement of cursor 20 while mouse 
button 19 is still down by branching to step 60. On the other hand. If the cursor 
current position is still very close to the mouse down position, then the 
processing logic continues to await indication of whether or not visual feedback 
is desired by branching back up to step 56. 

With step 60 the processing logic begins providing visual feedback to the 
computer user by de-emphasizing selected text 30. Selected text 30 can be de- 
emphasized In a number of ways that will be apparent to those skilled In the art. 
In one embodiment, de-emphasis of selected text 30 Is performed using a 
QuickDraw™ brand graphics processing routine, which transforms the white 
areas surrounding the text to light gray and black letters of the text to medium 
gray. Figure 3C illustrates de-emphasized selected text 30a according to this 
scheme. De-emphasis of selected text 30 achieved, the processing logic 
advances to step 62. 

In step 62 the processing logic creates text object 34 from selected text 
30. As used herein "text object" refers to a visual representation of selected text 
30, which may or may not Include all of selected text 30. Text object 34 need 
only Include sufficient text to remind the computer user selected text 30 without 
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unnecessarily obscuring much of the text 32 displayed on monitor 1 2. Text 
object 34 may be created by generating a bit map of selected text 30 and 
limiting Its size. Text object 34 may also be represented by a dotted outline of 
selected text 30. similar to what computer users see when they drag icons 
within the desktop window. Such a representation of text object 34 requires 
less CPU time but does not inform the computer user of selected text 30 which 
is being moved. 

Text object 34 may also be emphasized as compared to displayed text 
32. In one embodiment, text object 34 is emphasized using reverse video. 
Other methods of emphasizing text object 34 will be obvious to those skilled in 
the art. Therefore, the manner of creating and emphasizing text object 34 will 
not be described In detail herein. The processing logic branches to step 64 
after its creation of text object 34. 

The processing logic displays text object 34 at the source location during 
step 64. As used herein, "source location" refers to the initial location of 
selected text 30. Stated another way. "source location" refers to the location 
that is the source of selected text 30. 

Because it is initially displayed at the source location, text object 34 
obscures de-emphasized selected text 30 If they are both the same size. Once 
text object 34 is moved it no longer obscures selected text 30. The processing 
logic also displays insertion caret 36 near cursor 20 in step 64. As using herein 
"insertion caret" refers to any visual representation that indicates to the 
computer user the precise location in a body of text where selected text 30 may 
be Inserted. According to common word processing conventions, insertion 
caret 36 is visually represented by a thin vertical line. 

To provide further visual emphasis that the computer user is able to 
manipulate selected text 30. cursor 20 may be displayed as an arrow. 
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Processing logic for doing so will be described in detail herein below. When 
cursor 20 Is displayed as an arrow, insertion caret 36 is preferably displayed 
near tip 20a of cursor 20, as shown in Figures 3C and 3E. Initial display of 
insertion caret 36 and text object 34 begun, the processing logic proceeds to 
step 66. 

The processing logic begins the process of snapping text object 34 to 
cursor 20 in step 66. The processing logic does this by initializing an 
interpolation factor, which is used to snap text object 34 to cursor 20 in a 
discrete and finite number of steps. Text object 34 is gradually moved to cursor 
20 to prevent computer users from becoming disoriented by text object 34 
appearing in an unfamiliar location. This done, the processing logic enters the 
snapping and tracking logic by branching to step 68. 

The loop of steps 68-90 snaps text object 34 to cursor 20 and, once 
snapped, ensures that text object follows the movement of cursor 20 on monitor 
12. The first step within the loop is determining whether the interpolation factor 
has reached its maximum value of one. If it has not. text object 34 has not yet 
snapped to cursor 20. To continue snapping, the processing logic branches to 
step 70. On the other hand, if text object 34 has snapped to cursor 20, as 
indicated by the maximum value of the interpolation factor, the processing logic 
advances to step 72. 

During step 70 the interpolation factor is incremented. The amount by 
which the interpolation factor is incremented depends upon the choice of the 
number of steps for text object 34 to reach cursor 20. For example, if the 
number of steps chosen for text object 34 to reach cursor 20 is four, then the 
interpolation factor is incremented by 0.25 each pass through step 70. The 
number of steps chosen will depend upon the visual effect and response time 
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desired. After incrementing the interpolation factor, the processing logic 
branches to step 72. 

The processing logic moves text object 34 in step 72 to a location 
determined by the interpolation factor and the current distance between the 
source location and cursor 20. Thus, if the interpolation factor has not yet 
reached its maximum value, text object 34 will be moved toward cursor 20 
along an Imaginary straight line between the source location and cursor 20 to a 
locating determined by the distance multiplied by the interpolation factor. 
Stated another way. during step 72 text object 34 is moved to a location 
determined by a weighted average of the source location and the destination 
location using the interpolation factor. When the Interpolation factor reaches its 
maximum value, text object 34 snaps to cursor 20. Thereafter, text object 34 
follows the movement of cursor 20 providing a visual impression that text object 
34 is attached to cursor 20. This, in turn, gives the computer user a feeling of 
physical control. 

In one embodiment, text object 34 is snapped to the lower left hand of 
cursor 20, as shown in Figures 3C and 3D. This location prevents text object 34 
from obscuring insertion caret 36 and focuses the computer user's attention on 
insertion caret 36 and cursor 20 while maintaining the strong visual impression 
that text object 34 is attached to cursor 20. Those skilled in the art will 
appreciate that other locations near or on cursor 20 may also convey the same 
visual impression. 

After moving text object in step 72. the processing logic advances to step 
74. There the processing logic moves insertion caret 36 if cursor 20 has moved. 
Insertion caret 36 is moved to a location between the two characters nearest to 
cursor 20. This done the processing logic advances to step 76. 
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During step 76 the processing logic compares the current location of 
^ insertion caret 36 to its previous location. If insertion caret 36 has not moved 
^ from its previous location, the processing logic advances to step 78. There 
^' insertion caret 36 is "flashed." or blinked on and off. Indicating an idle state. On 
the other hand, if insertion caret 36 changed its location during step 74 then the 
^ processing logic advances to step 80. 

In step 80 the processing logic determines whether the computer user 
^ has selected an Insertion point, or destination location, for selected text 30. (As 
used herein "destination location" refers to the position of cursor 20 at the time 
of a mouse up event.) The processing logic makes this determination by 
discovering whether a mouse up event has occurred. A mouse up event 
'2. necessarily accompanies selection of a destination location or insertion point. 

The location of cursor 20 at the time of the mouse up event determines the 
'y Insertion point for selected text 30. The processing logic responds to a mouse 

up event by branching to step 82. Conversely, the absence of a mouse up 
^6 event indicates that the computer user has not yet selected the destination 
location. The processing logic responds to this state of affairs by branching 
fi back to the start of the tracking and snapping loop, step 68. 

After the mouse up event, with step 82 the processing logic begins the 
process of Indicating visually to the computer user the movement of selected 
text 30 from the source location to the destination location. This involves three 
'^ steps. Rrst, the processing logic calculates bounding rectangles for selected 
text 30 at both the source location and the destination location. Second, the 
2 Y processing logic zooms from the first bounding rectangle at the source location 
to the second bounding rectangle at the destination location. Finally, selected 
text 30 Is displayed at the destination location in the third and final step. 
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In step 82 the processing logic computes a bounding rectangle for 
selected text 30 at the source location. This step, and the second, are illustrated 
in Figure 4 using selected text 31 : I.e., "Jack and Jill." Bounding rectangle 100 
is defined by two points of selected text 31 : the point furthest to the top left and 
the point furthest to the bottom right. The dimensions of bounding rectangle 100 
computed, the processing logic proceeds to step 84. These points are chosen 
because the selected text may span vertically more than one line. 

In step 84, offscreen the processing logic moves selected text 31 to the 
destination location. As understood by those skilled In the art, computer 10 
maintains in Internal memory a copy of the text file that text displayed monitor 12 
is part of. This copy is said to be "offscreen." Thus, it will be understood that the 
activities of step 84 do not alter the text displayed on monitor 12. 

In moving selected text 31 to the destination location In step 84, the 
processing logic performs an intelligent paste, which is also commonly referred 
to as Intelligent cut and paste. Intelligent cut and paste Is a set of editing 
features that account for the need for spaces between words. Rgures 4A and 
4B Illustrate how intelligent cut and paste performs. In Figure 4A, insertion caret 
102 is the space immediately following the word "the." Without Intelligent cut 
and paste, after Inserting selected text 31 displayed text 33 would not Include a 
space between "Jack" and "the" unless selected text 32 includes a space before 
"Jack." Stated another way, without Intelligent cut and paste, after inserting 
selected text 31 the sixth line 104 of displayed text 33 would read as "assumed 
theJack." However, using Intelligent cut and paste, the sixth line 104 includes a 
space between "the" and "Jack." regardless of whether selected text 31 Includes 
a space before "Jack." Thus, using Intelligent cut and paste sixth line 104 reads 
as "assumed the Jack." as Illustrated In Figure 48. 
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After moving selected text 31 to the destination location, the processing 
2 logic emphasizes selected text 31. As a result when the offscreen copy of the 
file is finally displayed, the computer user's attention will be called to selected 
text 31 at the destination location. Selected text 31 may be emphasized visually 
in a great many ways, including displaying selected text 31 in reverse video. 

^ Whether selected text 31 is also removed from the source location during 
step 78 depends upon whether the computer user has requested a cut and 
^ paste or a copy and paste. If a cut and paste operation was selected text 31 is 
removed from the source location. Otherwise, selected text 31 remains at the 
' source location, but it will no longer be de-emphaslzed. 

The processing logic proceeds to step 86 from step 84. Having moved 
i selected text 31 to the destination location, the processing logic now computes 
a bounding rectangle for selected text 31 at the destination location. Like 
bounding rectangle 100, bounding rectangle 104 Is defined by two points of 
selected text 31 : the point of text furthest to the top left and the text point furthest 
^ to the bottom right. Given Insertion point 102, the dimensions of bounding 
rectangle 104 may vary from those of bounding rectangle 100. This is the case 
in figure 4B. 

Preparations for zooming complete, the processing logic branches to 
step 88 from step 86. In step 88. the processing logic zooms from selected text 
31 at the source location to selected text 31 at the destination location. 
Zooming is a well known visual effect that animates the movement of an object 
between two points on monitor 12. Methods for animating zooms are well 
known and will not be described In detail herein. The dimensions of bounding 
rectangles 100 and 104 are provided to a zoom processor. Given these, the 
zoom starts with a bounding rectangle 100 displayed near the source location. 
Two or more rectangles are displayed on monitor 1 2 at a time, each successive 
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rectangle more closely approaching the dimensions and final location of 
- bounding rectangle 104. Figure 4C attempts to illustrate this idea. The 

dimensions of intervening rectangle 106 differ slightly from those bounding 
^1 rectangle 100, just starting to approach those of bounding rectangle 104. 

Similarly, the dimensions of intervening rectangle 108 differ from those of 
^ intervening rectangle 106, approaching more closely the dimensions of 
bounding rectangle 104. The zooms ends with the display of bounding 
V rectangle 104 near the destination location. 

The processing logic advances to step 90 after the zoom is complete. 
^ There the processing logic displays onscreen selected text 31 at the destination 
location. Following as it does the zoom, the effect of step 78 is that the zoom 
' ^ drops selected text 31 at the destination location. 

The processing logic branches to step 92 from step 90 to await activation 

again. 

Additional visual feedback may be provided to the computer user to 
emphasize that selected text 30 may be dragged within a window, or between 
windows. Displaying cursor 20 as an arrow, rather than an I-beam, while cursor 
20 is over selected text 30 emphasizes this fact. Figure 5 illustrates In flow 
diagram form a method for doing so as a background process. 

The processing logic begins in step 110 by determining whether cursor 
20 Is over selected text 30. If cursor 20 Is not. the processing logic branches to 
step 112. There cursor 20 Is displayed as an I-beam. On the other hand, if 
cursor 20 is over selected text 30, the processing logic advances to step 114. 
During this step the processing logic displays cursor 20 as an arrow. Indicating 
that cursor 20 Is over a draggable item. 

Thus, a method and apparatus for providing visual feedback to a 
computer user while manipulating text has been described. The visual 
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feedback includes creation of a text object from selected text, tracking the 
insertion point as user moves mouse and zooming the selected text from its 
source location to its destination location. 

In the foregoing specification, the Invention has been described with 
reference to specific exemplary embodiments thereof. It will, however, be 
evident that various modifications and changes may be made thereto without 
departing from the broader spirit and scope of the Invention as set forth in the 
appended claims. The specification and drawings are, accordingly, to be 
regarded In an illustrative rather than a restrictive sense. 
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